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The  purpose  of  this  project  was  to  encourage  cognitive  scientists  to 
consider  the  implications  of  their  research  for  assessment  as  well  as  for 
instruction.  Conventional  methods  of  assessment  are  not  adequate  for  two 
reasons:  (a)  since  the  score  on  a  conventional  test  is  based  on  the  number  of 

correct  answers  to  a  set  of  items  that  vary  widely  in  difficulty  and  in 
content,  it  is  not  possible  to  obtain  such  qualitative  information  as  a 
student's  problem-solving  procedures  or  the  nature  of  his/her  mental  model  of 
a  domain;  and  (b)  the  items  of  conventional  tests  tend  to  emphasize  factual 
and  algorithmic  knowledge  rather  than  understanding. 

It  was  proposed  that  a  conference  be  held  at  which  leading  cognitive 
scientists  would  address  the  question  of  how  their  work  could  be  adapted  to 
assessing  various  aspects  of  performance  during  learning,  such  as  level  of 
automatization  of  basic  procedures,  incomplete  or  erroneous  knowledge 
structures,  and  inadequate  regulatory  control  strategies.  The  conference  was 
thus  intended  to  call  attention  to  the  need  for  diagnostic  monitoring  of  skill 
and  knowledge  acquisition  during  the  instructional  process  and  to  provide 
examples  of  assessment  methods  that  grow  out  of  cognitive  research. 

When  the  project  was  funded  in  the  fall  of  1985,  Michael  Shafto  was 
designated  Scientific  Officer,  and  arrangements  were  made  for  Robert  Glaser 
and  Alan  Lesgold  to  serve  as  advisors  to  the  project.  Our  first  task  was  to 
decide  on  who  should  be  invited  to  participate  in  the  conference.  After  a 
meeting  at  LRDC  and  after  allowing  several  weeks  for  consideration,  a 
selection  was  made  of  those  who  should  be  invited  to  present  papers  or  serve 
as  discussants.  Almost  all  of  those  invited  agreed  to  participate. 

Since  the  research  of  most  of  the  presenters  was  concerned  with  learning 
rather  than  assessment,  we  felt  that  a  special  effort  was  needed  to  orient 
them  toward  applications  of  their  work  toward  diagnosis  of  sources  of  error 
and  misconceptions,  and  thus  to  develop  a  shared  point  of  view  with  regard  to 
the  purpose  of  the  conference.  Therefore  a  planning  meeting  was  held  at  LRDC 
in  November  1985  at  which  the  theme  of  the  conference  was  discussed  and  each 
participant  was  given  an  opportunity  to  reflect  and  report  on  the  implications 
of  his  or  her  research  for  assessment.  The  goal  was  to  achieve  a  well- 
integrated  set  of  presentations  and  eventually  chapters  for  publication  in 
book  form. 

The  conference  was  held  at  the  Henry  Chauncey  Conference  Center  at  ETS 
on  July  17,  18,  and  19,  1986.  A  copy  of  the  program  is  attached.  The  confer¬ 
ence  was  attended  by  approximately  65  people,  including  not  only  cognitive 
scientists  but  also  educators,  educational  researchers,  and  psychometricians. 

At  the  time  of  the  conference,  a  contract  for  publication  of  the 
proceedings  by  Lawrence  Erlbaum  Associates  was  agreed  to.  The  four  editors 
are  N.  Frederiksen,  R.  Glaser,  A.  Lesgold,  and  M.  G.  Shafto.  The  MS  was  sent 
to  the  publisher  in  late  November,  1988.  Copies  of  the  title  page  and  the 
table  of  contents  are  appended.  The  MS  is  complete  except  for  one  commentary, 
which  may  yet  arrive  in  time  to  be  included  in  the  volume.  If  all  of  the 
corrected  proofs  are  returned  to  the  publisher  promptly,  the  publication  date 
should  be  in  the  late  fall  of  1989. 
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